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Introduction 



Over the past few decades it was realized that deterministic dynamical systems involving 
only a few variables can exhibit complexity reminiscent of many-particle systems if the dy- 
namics is chaotic, as can be quantified by the existence of a positive Ljapunov exponent 
[Sch89b]. Such systems provided important paradigms in order to construct a theory of 
nonequilibrium statistical physics starting from first principles, i.e., based on microscopic 
nonlinear equations of motion. This novel approach led to the discovery of fundamental re- 
lations characterizing transport in terms of deterministic chaos, of which formulas relating 
deterministic diffusion to differences between Ljapunov exponents and dynamical entropies 
form important examples [Dor99, Gas98, Kla07b]. More recently scientists learned that 
random-looking evolution in time and space also occurs under conditions that are weaker 
than requiring a positive Ljapunov exponent, which means that the separation of nearby 
trajectories is weaker than exponential [Kla07b]. This class of dynamical systems is called 
weakly chaotic and typically leads to transport processes that require descriptions going 
beyond standard methods of statistical mechanics. A paradigmatic example is the phe- 
nomenon of anomalous diffusion, where the mean square displacement of an ensemble of 
particles does not grow linearly in the long-time limit, as in case of ordinary Brownian mo- 
tion, but nonlinearly in time. Such anomalous tranport phenomena do not only pose new 
fundamental questions to theorists but were also observed in a large number of experiments 
[KlaOS]. 

This review gives a very tutorial introduction to all these topics in form of three chapters: 
Chapter 2 reminds of two basic concepts quantifying deterministic chaos in dynamical sys- 
tems, which are Ljapunov exponents and dynamical entropies. These approaches will be 
illustrated by studying simple one-dimensional maps. Slight generalizations of these maps 
will be used in Chapter 3 in order to motivate the problem of deterministic diffusion. Their 
analysis will yield an exact formula expressing diffusion in terms of deterministic chaos. In 
the first part of Chapter 4 we further generalize these simple maps such that they exhibit 
anomalous diffusion. This dynamics can be analyzed by applying continuous time random 
walk theory, a stochastic approach that leads to generalizations of ordinary laws of diffusion 
of which we derive a fractional diffusion equation as an example. Finally, we demonstrate the 
relevance of these theoretical concepts to experiments by studying the anomalous dynamics 
of biological cells migration. 

The degree of difficulty of the material presented increases from chapter to chapter, and 
the style of our presentation changes accordingly: While Chapter 2 mainly elaborates on 
textbook material of chaotic dynamical systems [Ott93, Bec93], Chapter 3 covers advanced 
topics that emerged in research over the past twenty years [Dor99, Gas98, Kla96b]. Both 
these chapters were successfully taught twice to first year Ph.D. students in form of five one- 
hour lectures. Chapter 4 covers topics that were presented by the author in two one-hour 
seminar talks and are closely related to recently published research articles [Kor05, Kor07, 



Die08]. 
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To clarify the general setting, we start with a brief reminder about the dynamics of time- 
discrete one-dimensional dynamical systems. We then quantify chaos in terms of Ljapunov 
exponents and (metric) entropies by focusing on systems that are closed on the unit interval. 
These ideas are then generalized to the case of open systems, where particles can escape 
(in terms of absorbing boundary conditions). Most of the concepts we are going to intro- 
duce carry over, suitably generalized, to higher-dimensional and time-continuous dynamical 
systems. 1 

2.1 Dynamics of simple maps 

As a warm-up, let us recall the following: 

Definition 1 Let JCM.,x ri EJ,nE7j. Then 

F:J^J , x n+1 = F(x n ) (2.1) 

is called a one-dimensional time-discrete map. x„+i = F(x n ) are sometimes called the 
equations of motion of the dynamical system. 

Choosing the initial condition xq determines the outcome after n discrete time steps, hence 
we speak of a deterministic dynamical system. It works as follows: 

Xl = F(x ) = F\x ), 

x 2 = F( Xl ) = F(F(x )) = F 2 (x ). 

=► F m (x ) := FoFo---F(x ) . (2.2) 

V v ' 

m-fold composed map 

In other words, there exists a unique solution to the equations of motion in form of x n = 
F(x n -i) = . . . = F n (xo), which is the counterpart of the flow for time-continuous systems. 
In the first two chapters we will focus on simple piecewise linear maps. The following one 
serves as a paradigmatic example [Sch89b, Ott93, A1197, Dor99]: 

Example 1 The Bernoulli shift (also shift map, doubling map, dyadic transformation) 
The Bernoulli shift shown in Fig. 2.1 can be defined by 

B : [0, 1) - [0, 1) , B(x) := 2x mod 1 = j ^>_ ^ ^^ < 1 . (2.3) 



lr The first two sections draw on Ref. [Kla07a], in case the reader needs a more detailed introduction. 
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o 1/2 1 

Figure 2.1: The Bernoulli shift. 



One may think about the dynamics of such maps as follows, see Fig. 2.2: Assume we fill 
the whole unit interval with a uniform distribution of points. We may now decompose the 
action of the Bernoulli shift into two steps: 

1. The map stretches the whole distribution of points by a factor of two, which leads to 
divergence of nearby trajectories. 

2. Then we cut the resulting line segment in the middle due to the the modulo operation 
mod 1, which leads to motion bounded on the unit interval. 



y=2x 



2x 



stmtr.h 



1/2 1 



-X- 



mod 1 




1/2 1 x 



cut 1 



Figure 2.2: Stretch-and-cut mechanism in the Bernoulli shift. 



The Bernoulli shift thus yields a simple example for an essentially nonlinear stretch-and-cut 
mechanism, as it typically generates deterministic chaos [Ott93]. Such basic mechanisms 
are also encountered in more realistic dynamical systems. We may remark that 'stretch 
and fold' or 'stretch, twist and fold' provide alternative mechanisms for generating chaotic 
behavior, see, e.g., the tent map. The reader may wish to play around with these ideas in 
thought experiments, where the sets of points is replaced by kneading dough. These ideas 
can be made mathematically precise in form of what is called mixing in dynamical systems, 
which is an important concept in the ergodic theory of dynamical systems [Arn68, Dor99]. 
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2.2 Ljapunov chaos 

In Ref. [Dev89] Devaney defines chaos by requiring that for a given dynamical system three 
conditions have to be fulfilled: sensitivity, existence of a dense orbit, and that the periodic 
points are dense. The Ljapunov exponent generalizes the concept of sensitivity in form of a 
quantity that can be calculated more conveniently, as we will motivate by an example: 

Example 2 Ljapunov instability of the Bernoulli shift [Ott93, Rob95] 
Consider two points that are initially displaced from each other by Sxq := |xq — a;o| with 5xq 
"infinitesimally small" such that xq , x' do not hit different branches of the Bernoulli shift 
B(x) around x = 1/2. We then have 



V Jj an. • X <n -^T 



25x 



n-1 



2 2 Sx 



n-2 



2 n Sx 



z nlli2 8x 



(2.4) 



We thus see that there is an exponential separation between two nearby points as we follow 
their trajectories. The rate of separation \(xq) := In 2 is called the (local) Ljapunov exponent 
of the map B(x). 

This simple example can be generalized as follows, leading to the general definition of the 
Ljapunov exponent for one- dimensional maps F. Consider 



5x r 



V 



x n \ = \F n (x' ) - F n (x )\ =: 5x e nX ^ (6x - 0) 



(2.5) 



for which we presuppose that an exponential separation of trajectories exists. 2 By further- 
more assuming that F is differentiable we can rewrite this equation to 



\{x ) 



lim lim — In 



n-*oo Sxo^O n Sxo 

lim lim l ln |f(*. + fao)-F-(* )| 

n^oo 5x ->0 n OXq 



lim — In 

n^oo ft 



dF n (x) 



d.r 



(2.6) 



X=XQ 



Using the chain rule we obtain 

dF n (x) 



dx 



F\x n ^)F'{x, 



n-2 



F'(x ) 



(2.7) 



x=x 



which leads to 



\(x ) 



lim — In 

n— >oo n 



n-1 



•' '/ 



n-1 



n r 

i=0 

I - i 
lim — y In \F'(x. 

n— >oo 77, ^— ' 

i=0 

This simple calculation motivates the following definition 



(2.8) 



2 We emphasize that this is not always the case, see, e.g., Section 17.4 of [Kla07b]. 
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Definition 2 [AIW7] Let F G C 1 be a map of the real line. The local Ljapunov exponent 
X(xq) is defined as 

n-l 

AOo) := lim - > la\F'(xi)\ (2.9) 

i=0 

«/ i/izs Hmzi exists. 3 



Remark 1 

1. If F is not C 1 but piecewise C 1 , the definition can still be applied by excluding single 
points of non-differentiability. 

2. If F'(xi) = =^jQ\(x). However, usually this concerns only an 'atypical' set of points. 

Example 3 For the Bernoulli shift B(x) = 2x mod 1 we have B'(x) = 2Vx G [0, 1) , x ^ |, 
hence trivially 

1 n— 1 

A(x) = - Vln2 = ln2 (2.10) 



71 

fc=0 



at these points. 



Note that Definition 2 defines the local Ljapunov exponent X(xq), that is, this quantity may 
depend on our choice of initial conditions xq. For the Bernoulli shift this is not the case, 
because this map has a uniform slope of two except at the point of discontinuity, which 
makes the calculation trivial. Generally the situation is more complicated. One question is 
then of how to calculate the local Ljapunov exponent, and another one to which extent it 
depends on initial conditions. An answer to both these questions is provided in form of the 
global Ljapunov exponent that we are going to introduce, which does not depend on initial 
conditions and thus characterizes the stability of the map as a whole. 
It is introduced by observing that the local Ljapunov exponent in Definition 2 is defined 
in form of a time average, where n terms along the trajectory with initial condition x are 
summed up by averaging over n. That this is not the only possibility to define an average 
quantity is clarified by the following definition: 

Definition 3 time and ensemble average [Dor99, Arn68] 

Let n* be the invariant probability measure of a one- dimensional map F acting on J C M. 

Let us consider a function g : J — > R, which we may call an "observable" . Then 

.. n— 1 



g(x):= lim -^g(x k ) , (2.11) 

n— >oo n *— ' 

fc=0 



x = Xq, is called the time (or Birkhoff) average of g with respect to F. 



(g) := J dfi*g(x) (2.12) 

where, if such a measure exists, dfx* = p*{x) dx, is called the ensemble (or space) average of 
g with respect to F . Here p*(x) is the invariant density of the map, and dfi* is the associated 
invariant measure [Ott93, Las94, KlaOla]. Note that g(x) may depend on x, whereas (g) 
does not. 



3 This definition was proposed by A.M. Ljapunov in his Ph.D. thesis 1892. 
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If we choose g(x) = In |F'(a;)| as the observable in Eq. (2.11) we recover Definition 2 for the 
local Ljapunov exponent, 



.. n— 1 

X(x) :=ln|F'(x)| = lim - Vln |F'(x*)| , (2.13) 



fc=0 



which we may write as At (a;) = A(x) in order to label it as a time average. If we choose the 
same observable for the ensemble average Eq. (2.12) we obtain 

A e := (\n\F'(x)\) := f dxp*(x)ln\F'(x)\ . (2.14) 

Example 4 For the Bernoulli shift we have seen that for almost every x G [0, 1) X t = In 2. 
For A P we obtain 



A e = / dxp*(x)ln2 = ln2 , (2.15) 

Jo 

taking into account that p*(x) = 1, as you have seen before. In other words, time and 

ensemble average are the same for almost every x, 

A t (x) = A e = ln2 . (2.16) 

This motivates the following fundamental definition: 

Definition 4 ergodicity [Arn68, Dor99] i 

A dynamical system is called ergodic if for every g on J C R satisfying J d/i* \g{x)\ < oo 5 



g(x) = (g) (2.17) 

for typical x. 

For our purpose it suffices to think of a typical x as a point that is randomly drawn from the 
invariant density p*(x). This definition implies that for ergodic dynamical systems g{x) does 
not depend on x. That the time average is constant is sometimes also taken as a definition 
of ergodicity [Dor99, Bec93]. To prove that a given system is ergodic is typically a hard 
task and one of the fundamental problems in the ergodic theory of dynamical systems; see 
[Arn68, Dor99, Tod92] for proofs of ergodicity in case of some simple examples. 
On this basis, let us get back to Ljapunov exponents. For time average Xt(x) and ensemble 
average A e of the Bernoulli shift we have found that A t (x) = A e = In 2. Definition 4 now 
states that the first equality must hold whenever a map F is ergodic. This means, in turn, 
that for an ergodic dynamical system the Ljapunov exponent becomes a global quantity 
characterizing a given map F for a typical point x irrespective of what value we choose for 
the initial condition, Aj(x) = A e = A. This observation very much facilitates the calculation 
of A, as is demonstrated by the following example: 

Example 5 Let us consider the map A(x) displayed in Fig. 2.3 below: 

4 Note that mathematicians prefer to define ergodicity by using the concept of indecomposability [Kat95]. 

5 This condition means that we require g to be a Lebesgue-integrable function. In other words, g should 
be an element of the function space L 1 ( J, #f, fj,*) of a set J, a er-algebra srf of subsets of J and an invariant 
measure /i*. This space defines the family of all possible real- valued measurable functions g satisfying 
f djjf \g(x)\ < oo, where this integral should be understood as a Lebesgue integral [Las94]. 
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A(x) 




Figure 2.3: A simple map for demonstrating the calculation of Ljapunov exponents via 
ensemble averages. 



From the figure we can infer that 

A{x) :-- 



|x , < x < | 
3x - 2 , | < x < 1 



(2.18) 



It is not hard to see that the invariant probability density of this map is uniform, p*(x) = 1. 
The Ljapunov exponent A for this map is then trivially calculated to 



A 



dxp*(x)ln|^4'(x)| 



In3--hi2 
3 



(2.19) 



By assuming that map A is ergodic (which here is the case), we can conclude that this result 
for A represents the value for typical points in the domain of A. 

In other words, for an ergodic map the global Ljapunov exponent A yields a number that 
assesses whether it is chaotic in the sense of exhibiting an exponential dynamical instability. 
This motivates the following definition of deterministic chaos: 

Definition 5 Chaos in the sense of Ljapunov [Rob95, Ott93, A1197, Bec93] 

An ergodic map F : J — > J, JCR, F (piecewise) C 1 is said to be L-chaotic on J if A > 0. 

Why did we introduce a definition of chaos that is different from Devaney's definition men- 
tioned earlier? One reason is that often the largest Ljapunov exponent of a dynamical 
system is easier to calculate than checking for sensitivity 6 Furthermore, the magnitude of 
the positive Ljapunov exponent quantifies the strength of chaos. This is the reason why 
in the applied sciences "chaos in the sense of Ljapunov" became a very popular concept. 7 
Note that there is no unique quantifier of deterministic chaos. Many different definitions are 
available highlighting different aspects of "chaotic behavior" , all having their advantages and 



6 Note that a positive Ljapunov exponent implies sensitivity, but the converse does not hold true [Kla07a]. 
7 Here one often silently assumes that a given dynamical system is ergodic. To prove that a system is 
topologically transitive as required by Devaney's definition is not any easier. 
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(b) 



Figure 2.4: Schematic representation of a gas of molecules in a box. In (a) the gas is 
constrained by a piston to the left hand side of the box, in (b) the piston is removed and the 
gas can spread out over the whole box. This illustrates the basic idea of (physical) entropy 
production. 



disadvantages. The detailed relations between them (such as the ones between Ljapunov 
and Devaney chaos) are usually non-trivial and a topic of ongoing research [Kla07a]. We 
will encounter yet another definition of chaos in the following section. 



2.3 Entropies 

This section particularly builds upon the presentations in [Ott93, Dor99]; for a more math- 
ematical approach see [Eck85] . Let us start with a brief motivation outlining the basic idea 
of entropy production in dynamical systems. Consider again the Bernoulli shift by decom- 
posing its domain J = [0, 1) into J := [0, 1/2) and J\ := [1/2, 1). For x G [0, 1) define the 
output map s by [Sch89b] 



s: [0,1) -{0,1}, s(x) 



, x G Jo 

1 , X G J\ 



(2.20) 



and let s n+ i := s(x n ). Now choose some initial condition x G J. According to the above rule 
we obtain a digit si G {0, 1}. Iterating the Bernoulli shift according to x n+ i = B(x n ) then 
generates a sequence of digits {s 1; s 2 , ■ ■ ■ , s n }. This sequence yields nothing else than the 
binary representation of the given initial condition xq [Sch89b, Ott93, Dor99]. If we assume 
that we pick an initial condition xq at random and feed it into our map without knowing 
about its precise value, this simple algorithm enables us to find out what number we have 
actually chosen. In other words, here we have a mechanism of creation of information about 
the initial condition xq by analyzing the chaotic orbit generated from it as time evolves. 
Conversely, if we now assume that we already knew the initial state up to, say, m digits pre- 
cision and we iterate p > m times, we see that the map simultaneously destroys information 
about the current and future states, in terms of digits, as time evolves. So creation of infor- 
mation about previous states goes along with loss of information about current and future 
states. This process is quantified by the Kolmogorov-Sinai (KS) entropy (also called metric, 
or measure-theoretic entropy), which measures the exponential rate at which information is 
produced, respectively lost in a dynamical system, as we will see below. 
The situation is similar to the following thought experiment illustrated in Fig. 2.4: Let us 
assume we have a gas consisting of molecules, depicted as billiard balls, which is constrained 



10 2 Deterministic chaos 



to the left half of the box as shown in (a). This is like having some information about the 
initial conditions of all gas molecules, which are in a more localized, or ordered, state. If we 
remove the piston as in (b), we observe that the gas spreads out over the full box until it 
reaches a uniform equilibrium steady state. We then have less information available about 
the actual positions of all gas molecules, that is, we have increased the disorder of the 
whole system. This observation lies at the heart of what is called thermodynamic entropy 
production in the statistical physics of many-particle systems which, however, is usually 
assessed by quantities that are different from the KS-entropy [Fal05]. 

At this point we may not further elaborate on the relation to statistical physical theories. 
Instead, let us make precise what we mean by KS-entropy starting from the famous Shannon 
(or information) entropy [Ott93, Bec93]. This entropy is defined as 

H s :=Yp t \n(-) , (2.21) 



V^hi(-) , 



where pt , i = 1, . . . ,r are the probabilities for the r possible outcomes of an experiment. 
Think, for example, of a roulette game, where carrying out the experiment one time cor- 
responds to n — 1 in the iteration of an unknown map. H$ then measures the amount of 
uncertainty concerning the outcome of the experiment, which can be understood as follows: 

1. Let pi = 1 , pi — otherwise. By defining p^ln I — ) :— , i ^ 1, we have Hs = 0. 
This value of the Shannon entropy must therefore characterize the situation where the 
outcome is completely certain. 

2. Let Pi = 1/r , i = 1,2, ...,r. Then we obtain H$ = lnr thus characterizing the 
situation where the outcome is most uncertain because of equal probabilities. 

Case (1) thus represents the situation of no information gain by doing the experiment, case 
(2) corresponds to maximum information gain. These two special cases must therefore define 
the lower and upper bounds of Hs, 8 

0<H s <lnr . (2.22) 

This basic concept of information theory carries over to dynamical systems by identifying 
the probabilities pi with invariant probability measures fi* on subintervals of a given dynam- 
ical system's phase space. The precise connection is worked out in four steps [Ott93, Dor99]: 

1. Partition and refinement: 

Consider a map F acting on J C IR, and let fi* be an invariant probability measure generated 
by the map. 9 Let {J%}, i = 1, . . . , s be a partition of J. 10 We now construct a refinement of 
this partition as illustrated by the following example: 



8 A proof employs the convexity of the entropy function and Jensen's inequality, see [Bad97] or the 
Wikipedia entry of information entropy for details. 

9 If not said otherwise, /x* holds for the physical (or natural) measure of the map in the following [Kla07a]. 
10 A partition of the interval J is a collection of subintervals whose union is J, which are pairwise disjoint 



except perhaps at the end points [A1197]. 
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Example 6 Consider the Bernoulli shift displayed in Fig. 2.5. Start with the partition 
{ Jo, Ji} shown in (a). Now create a refined partition by iterating these two partition parts 
backwards according to I? -1 ^) as indicated in (b). Alternatively, you may take the second 
forward iterate B 2 (x) of the Bernoulli shift and then identify the preimages of x = 1/2 for 
this map. In either case the new partition parts are obtained to 



Joo 
Joi 
Jio 
Jn 



{x : x E J , B(x) E J } 
{x : x E Jo , B(x) E J\] 
{x : x E J\ , B(x) E J } 
{x : x E J\ , B(x) E J\} 



(2.23) 
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(b) 
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Figure 2.5: (a) The Bernoulli shift and a partition of the unit interval consisting of two 
parts, (b) Refinement of this partition under backward iteration. 



If we choose Xo E Joo we thus know in advance that the orbit emerging from this initial 
condition under iteration of the map will remain in Jo at the next iteration. That way, the 
refined partition clearly yields more information about the dynamics of single orbits. 

More generally, for a given map F the above procedure is equivalent to defining 

{J ili2 }:={J h nF- l (J i2 )} . (2.24) 

The next round of refinement proceeds along the same lines yielding 

{J niw }--={JnnF-\j l2 )nF- 2 (j i3 )} , (2.25) 

and so on. For convenience we define 

Ul 1 } ■= {-WU = {\ n F~\j h ) n . . . n F-^\j ln )} . (2.26) 

2. H-function: 
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In analogy to the Shannon entropy Eq. (2.21) next we define the function 

i^{Jf}):=-X>Vf)l^Vr) , (2-27) 

i 

where p*{J^) is the invariant measure of the map F on the partition part J™ of the nth 
refinement . 

Example 7 For the Bernoulli shift with uniform invariant probability density p*(x) = 1 
and associated (Lebesgue) measure «*(</") = J T „ dx p*(x) = diam(J") we can calculate 

H({J}}) = -(^4 + ^lni) = ln2 

H({J?}) = H({J li nB~\j l2 )}) = -4(\\n 1 -)=\n4 
H({jf}) = ...=ln8 = ln2 3 

H{{J?}) = ln2 n (2.28) 

3. Take the limit: 

We now look at what we obtain in the limit of infinitely refined partition by 

h({Jn) := Hm -H({J?}) , (2.29) 

which defines the rate of gain of information over n refinements. 
Example 8 For the Bernoulli shift we trivially obtain 11 

&({#})= In 2 • (2-30) 

4. Supremum over partitions: 

We finish the definition of the KS-entropy by maximizing h({J™}) over all available parti- 
tions, 

h K8 :=svph({J?}) • (2.31) 

The last step can be avoided if the partition { J"} is generating for which it must hold that 
diam (J™) — > (n — > oo) [Eck85, Kat95, Bad97]. 12 It is quite obvious that for the Bernoulli 
shift the partition chosen above is generating in that sense, hence hxs = hi 2 for this map. 

Remark 2 [Sch89b] 

1. For strictly periodic motion there is no refinement of partition parts under backward 
iteration, hence hxs — 0; see, for example, the identity map I(x) = x. 



11 In fact, this result is already obtained after a single iteration step, i.e., without taking the limit of 
n — > oo. This reflects the fact that the Bernoulli shift dynamics sampled that way is mapped onto a Markov 
process. 

12 Note that alternative definitions of a generating partition in terms of symbolic dynamics are possible 
[Bec93]. 
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2. For stochastic systems all preimages are possible, so there is immediately an infinite 
refinement of partition parts under backward iteration, which leads to Hks ~~ * °°- 

These considerations suggest yet another definition of deterministic chaos: 

Definition 6 Measure-theoretic chaos [Bec93] 

A map F : J —> J, J C R, is said to be chaotic in the sense of exhibiting dynamical 

randomness if hxs > . 

Again, one may wonder about the relation between this new definition and our previous one 
in terms of Ljapunov chaos. Let us look again at the Bernoulli shift: 

Example 9 For B(x) we have calculated the Ljapunov exponent to A = In 2, see Example 4. 
Above we have seen that Hks = ln2 for this map, so we arrive at A = Hks — l n 2. 

That this equality is not an artefact due to the simplicity of our chosen model is stated by 
the following theorem: 

Theorem 1 Pesm's Theorem (1977) [Dor99, Eck85, You02] 

For closed C 2 Anosov 13 systems the KS- entropy is equal to the sum of positive Ljapunov 

exponents. 

A proof of this theorem goes considerably beyond the scope of this course [You02]. In the 
given formulation it applies to higher- dimensional dynamical systems that are "suitably well- 
behaved" in the sense of exhibiting the Anosov property. Applied to one-dimensional maps, 
it means that if we consider transformations which are "closed" by mapping an interval onto 
itself, F : J — > J, under certain conditions (which we do not further specify here) and if 
there is a positive Ljapunov exponent A > we can expect that A = Hks-, as we have seen 
for the Bernoulli shift. In fact, the Bernoulli shift provides an example of a map that does 
not fulfill the conditions of the above theorem precisely. However, the theorem can also be 
formulated under weaker assumptions, and it is believed to hold for an even wider class of 
dynamical systems. 

In order to get an intuition why this theorem should hold, let us look at the information 
creation in a simple one-dimensional map such as the Bernoulli shift by considering two 
orbits {xfc}^ =0 , {x' k } k=0 starting at nearby initial conditions \x' — x$\ < 5x , 5x <C 1. Recall 
the encoding defined by Eq. (2.20). Under the first m iterations these two orbits will then 
produce the very same sequences of symbols {sk}™ =1 , {s' k }™ =1 , that is, we cannot distinguish 
them from each other by our encoding. However, due to the ongoing stretching of the initial 
displacement 5xq by a factor of two, eventually there will be an m such that starting from 
p > m iterations different symbol sequences are generated. Thus we can be sure that in the 
limit of n — * oo we will be able to distinguish initially arbitrarily close orbits. If you like 
analogies, you may think of extracting information about the different initial states via the 
stretching produced by the iteration process like using a magnifying glass. Therefore, under 
iteration the exponential rate of separation of nearby trajectories, which is quantified by 
the positive Ljapunov exponent, must be equal to the rate of information generated, which 
in turn is given by the KS-entropy. This is at the heart of Pesin's theorem. 



13 An Anosov system is a diffeomorphism, where the expanding and contracting directions in phase space 
exhibit a particularly "nice", so-called hyperbolic structure [Eck85, Dor99]. 
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We may remark that typically the KS-entropy is much harder to calculate for a given 
dynamical system than positive Ljapunov exponents. Hence, Pesin's theorem is often em- 
ployed in the literature for indirectly calculating the KS-entropy. Furthermore, here we 
have described only one type of entropy for dynamical systems. It should be noted that the 
concept of the KS-entropy can straightforwardly be generalized leading to a whole spectrum 
of Renyi entropies, which can then be identified with topological, metric, correlation and 
other higher-order entropies [Bcc93]. 

2.4 Open systems, fractals and escape rates 

This section draws particularly on [Ott93, Dor99]. So far we have only studied closed 
systems, where intervals are mapped onto themselves. Let us now consider an open system, 
where points can leave the unit interval by never coming back to it. Consequently, in contrast 
to closed systems the total number of points is not conserved anymore. This situation can 
be modeled by a slightly generalized example of the Bernoulli shift. 

Example 10 In the following we will study the map 

Ba : |0, 1) - [1 - o/ 2,a/2) , B.& := { « ;° 1* *$< x<1 , (2-32) 

see Fig. 2.6, where the slope a > 2 defines a control parameter. For a = 2 we recover 
our familiar Bernoulli shift, whereas for a > 2 the map defines an open system. That is, 
whenever points are mapped into the escape region of width A these points are removed 
from the unit interval. You may thus think of the escape region as a subinterval that absorbs 
any particles mapped onto it. 

We now wish to compute the number of points N n remaining on the unit interval at time 
step n, where we start from a uniform distribution oi N = N points on this interval at 
n — 0. This can be done as follows: Recall that the probability density p n {x) was defined 
by 

number of points N n j in interval dx centered around position Xj at time step n 

total number of points N times width dx 

(2.33) 
where N n = ^ . N n j. With this we have that 

jVi = N - p NA . (2.34) 

By observing that for B a (x), starting from po = 1 points are always uniformly distributed 
on the unit interval at subsequent iterations, we can derive an equation for the density p\ 
of points covering the unit interval at the next time step n = 1. For this purpose we divide 
the above equation by the total number of points N (multiplied with the total width of the 
unit interval, which however is one), which yields 

Pi = ^ = Po-PoA = p (l-A) . (2.35) 

This procedure can be reiterated starting now from 

N 2 = JVi - piNA (2.36) 
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Figure 2.6: A generalization of the Bernoulli shift, defined as a parameter-dependent map 
B a {x) modeling an open system. The slope a defines a control parameter, A denotes the 
width of the escape region. 



leading to 



p 2 = ^ = Pi(l-A) 



and so on. For general n we thus obtain 

p n = P„-i(l - A) = Po (l - A)" = poe^ 1 -^ , 

or correspondingly 

N n = N n e nMl ~ A) , 



(2.37) 

(2.38) 
(2.39) 



which suggests the following definition: 



Definition 7 For an open system with exponential decrease of the number of points, 

N n = N e^ n , (2.40) 

7 is called the escape rate. 
In case of our mapping we thus identify 

1 



7 = In 



1-A 



(2.41) 



as the escape rate. We may now wonder whether there are any initial conditions that 
never leave the unit interval and about the character of this set of points. The set can be 
constructed as exemplified for B a {x) , a = 3 in Fig. 2.7. 
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^ escape 




escape -^ 



Figure 2.7: Construction of the set Cb 3 of initial conditions of the map B^(x) that never 
leave the unit interval. 



Example 11 Let us start again with a uniform distribution of points on the unit interval. 
We can then see that the points which remain on the unit interval after one iteration of the 
map form two sets, each of length 1/3. Iterating now the boundary points of the escape 
region backwards in time according to x n = B^ 1 (x n+ i), we can obtain all preimages of 
the escape region. We find that initial points which remain on the unit interval after two 
iterations belong to four smaller sets, each of length 1/9, as depicted at the bottom of 
Fig. 2.7. Repeating this procedure infinitely many times reveals that the points which never 
leave the unit interval form the very special set Cb 3 , which is known as the middle third 
Cantor set. 

Definition 8 Cantor set [Ott93, Dev89] 

A Cantor set is a closed set which consists entirely of boundary points each of which is a 

limit point of the set. 

Let us explore some fundamental properties of the set Cb 3 [Ott93] : 

1. From Fig. 2.7 we can infer that the total length l n of the intervals of points remaining 
on the unit interval after n iterations, which is identical with the Lebesgue measure 
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Hl of these sets, is 



*o = l, *i = |, h = ^= (I) ,---X= (2-42) 



3 9 V3/ V3 

We thus see that 

In = Q J -► (n -► oo) , (2.43) 

that is, the total length of this set goes to zero, (Al(Cb 3 ) — 0- However, there exist also 
Cantor sets whose Lebesgue measure is larger than zero [Ott93]. Note that matching 
l n = exp(— nln(3/2)) to Eq. (2.41) yields an escape rate of 7 = ln(3/2) for this map. 

2. By using the binary encoding Eq. (2.20) for all intervals of Cb 3 , thus mapping all 
elements of this set onto all the numbers in the unit interval, it can nevertheless be 
shown that our Cantor set contains an uncountable number of points [Dor99, Tri95]. 

3. By construction Cb 3 must be the invariant set of the map B$(x) under iteration, so 
the invariant measure of our open system must be the measure defined on the Cantor 
set, 11* '(C) , C G Cb 3 [Kat95]; see the following Example 12 for the procedure of how to 
calculate this measure. 

4. For the next property we need the following definition: 

Definition 9 reseller [Bec93, Dor 99] 

The limit set of points that never escape is called a repeller. The orbits that escape 
are transients, and I/7 is the typical duration of them. 

From this we can conclude that Cb 3 represents the repeller of the map B^(x). 

5. Since Cb 3 is completely disconnected by only consisting of boundary points, its topol- 
ogy is highly singular. Consequently, no invariant density p*(x) can be defined on this 
set, since this concept presupposes a certain "smoothness" of the underlying topology 
such that one can meaningfully speak of "small subintervals dx" on which one counts 
the number of points, see Eq. (2.33). In contrast, u*(C) is still well-defined, 14 and we 
speak of it as a singular measure [Kla07a, Dor99]. 

6. Fig. 2.7 shows that Cb 3 is self-similar, in the sense that smaller pieces of this structure 
reproduce the entire set upon magnification [Ott93]. Here we find that the whole set 
can be reproduced by magnifying the fundamental structure of two subsets with a gap 
in the middle by a constant factor of three. Often such a simple scaling law does not 
exist for these types of sets. Instead, the scaling may depend on the position x of the 
subset, in which case one speaks of a self-affine structure [Man82, Fal90]. 

7. Again we need a definition: 

Definition 10 fractals, qualitatively [Bec93, FaWOj 

Fractals are geometrical objects that possess nontrivial structure on arbitrarily fine 
scales. 



4 This is one of the reasons why mathematicians prefer to deal with measures instead of densities. 
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In case of our Cantor set Cb 3 , these structures are generated by a simple scaling 
law. However, generally fractals can be arbitrarily complicated on finer and finer 
scales. A famous example of a fractal in nature, mentioned in the pioneering book by 
Mandelbrot [Man82], is the coastline of Britain. An example of a structure that is 
trivial, hence not fractal, is a straight line. The fractality of such complicated sets can 
be assessed by quantities called fractal dimensions [Ott93, Bec93], which generalize the 
integer dimensionality of Euclidean geometry. It is interesting how in our case fractal 
geometry naturally comes into play, forming an important ingredient of the theory 
of dynamical systems. However, here we do not further elaborate on the concept of 
fractal geometry and refer to the literature instead [Tri95, Fal90, Man82, Ott93]. 

Example 12 Let us now compute all three basic quantities that we have introduced so far, 
that is: the Ljapunov exponent A and the KS-entropy hk s on the invariant set as well as 
the escape rate 7 from this set. We do so for the map B 3 (x) which, as we have learned, 
produces a fractal repeller. According to Eqs. (2. 12), (2. 14) we have to calculate 

X(C B[i )= [ d^\n\B' 3 (x)\ . (2.44) 

Jo 

However, for typical points we have B' 3 (x) = 3, hence the Ljapunov exponent must trivially 
be 

A(C B3 ) = hi3 , (2.45) 

because the probability measure u* is normalised. The calculation of the KS-entropy requires 
a bit more work: Recall that 

2" 

H({Cn):=-J2fi*(C?)\nu,*(C?) , (2.46) 

i=l 

see Eq. (2.27), where C™ denotes the ith part of the emerging Cantor set at the nth level of 
its construction. We now proceed along the lines of Example 7. From Fig. 2.7 we can infer 
that 



»*(C}) = -f-2 



i 1 
2 

3 



at the first level of refinement. Note that here we have renormalized the (Lebesgue) measure 
on the partition part C}. That is, we have divided the measure by the total measure 
surviving on all partition parts such that we always arrive at a proper probability measure 
under iteration. The measure constructed that way is known as the conditionally invariant 
measure on the Cantor set [T6190, Bec93]. Repeating this procedure yields 



M*(Q 2 ) 






AW) = ^ = 2" n (2.47) 



from which we obtain 

2" 

H({Cl L }) = -J2 2 ~ H ln 2" n = n In 2 . (2.48) 

i=i 

We thus see that by taking the limit according to Eq. (2.29) and noting that our partitioning 
is generating on the fractal repeller Cb 3 = {C?°}, we arrive at 

h KS {C Ba ) = lim -#({£"}) = In 2 . (2.49) 

ra^oo 77, 

Finally, with Eq.(2.41) and an escape region of size A = 1/3 for B 3 (x) we get for the escape 
rate 

7 (C B3 ) = ln r ^ = l4 > ( 2 - 5 °) 

as we have already seen before. 15 

In summary, we have that 7(Cb 3 ) = In | = ln3 — ln2, X(Cb 3 ) = ln3, h KS {CB 3 ) = In 2, which 
suggests the relation 

7 (C Bs ) = X(C B3 ) - h KS (C B3 ) . (2.51) 

Again, this equation is no coincidence. It is a generalization of Pesin's theorem to open 
systems, known as the escape rate formula [Kan85]. This equation holds under similar 
conditions like Pesin's theorem, which is recovered from it if there is no escape [Dor99]. 
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We now apply the concepts of dynamical systems theory developed in the previous chapter 
to a fundamental problem in nonequilibrium statistical physics, which is to understand 
the microscopic origin of diffusion in many-particle systems. We start with a reminder 
of diffusion as a simple random walk on the line. Modeling such processes by suitably 
generalizing the piecewise linear map studied previously, we will see how diffusion can be 
generated by microscopic deterministic chaos. The main result will be an exact formula 
relating the diffusion coefficient, which characterizes macroscopic diffusion of particles, to 
the dynamical systems quantities introduced before. 

In Section 3.1, which draws upon Section 2.1 of [Kla07b], we explain the basic idea of 
deterministic diffusion and introduce our model. Section 3.2, which is partially based on 
[Kla95, Kla96b, Kla99], outlines a method of how to exactly calculate the diffusion coefficient 
for such types of dynamical systems. 



15 Note that the escape rate will generally depend not only on the size but also on the position of the 
escape interval [Bun08]. 
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n 

Figure 3.1: The "problem of the random walk" in terms of a drunken sailor at a lamppost. 
The space-time diagram shows an example of a trajectory for such a drunken sailor, where 
nGN holds for discrete time and i G 1 for the position of the sailor on a discrete lattice 
of spacing s. 

3.1 What is deterministic diffusion? 



In order to learn about deterministic diffusion, we must first understand what ordinary 
diffusion is all about. Here we introduce this concept by means of a famous example, see 
Fig. 3.1: Let us imagine that some evening a sailor wants to walk home, however, he is 
completely drunk such that he has no control over his single steps. For sake of simplicity let 
us imagine that he moves in one dimension. He starts at a lamppost at position x = and 
then makes steps of a certain step length s to the left and to the right. Since he is completely 
drunk he looses all memory between any single steps, that is, all steps are uncorrelated. It 
is like tossing a coin in order to decide whether to go to the left or to the right at the next 
step. We may now ask for the probability to find the sailor after n steps at position x, i.e., 
a distance \x\ away from his starting point. 

Let us add a short historial note: This "problem of considerable interest" was first formulated 
(in three dimensions) by Karl Pearson in a letter to Nature in 1905 [Pea05]. He asked for a 
solution, which was provided by Lord Rayleigh referring to older work by himself [Ray05]. 
Pearson concluded: "The lesson of Lord Rayleigh's solution is that in open country the 
most probable place to find a drunken man, who is at all capable of keeping on his feet, 
is somewhere near his starting point" [Pca05]. This refers to the Gaussian probability 
distributions for the sailor's positions, which are obtained in a suitable scaling limit from 
a Gedankenexperiment with an ensemble of sailors starting from the lamppost. Fig. 3.2 
sketches the spreading of such a diffusing distribution of sailors in time. The mathematical 
reason for the emerging Gaussianity of the probability distributions is nothing else than the 
central limit theorem [Rei65]. 
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Figure 3.2: Probability distribution functions p n (x) to find a sailor after n time steps at 
position x on the line, calculated for an ensemble of sailors starting at the lamppost, cf. 
Fig. 3.1. Shown are three probability densities after different numbers of iteration n\ < 
n 2 < n 3 . 



We may now wish to quantify the speed by which a "droplet of sailors" starting at the 
lamppost spreads out. This can be done by calculating the diffusion coefficient for this 
system. In case of one-dimensional dynamics the diffusion coefficient can be defined by the 
Einstein formula 

(3.1) 



D :-- 



lim — < x 

n—>oo In 



> 



where 



< x >:- 



dx X 2 p n (x) 



(3.2) 



is the variance, or second moment, of the probability distribution p n (x) at time step n, 
also called mean square displacement of the particles. This formula may be understood as 
follows: For our ensemble of sailors we may choose po(x) = 5(x) as the initial probability 
distribution with 5(x) denoting the (Dirac) 5-function, which mimicks the situation that 
all sailors start at the same lamppost at x = 0. If our system is ergodic the diffusion 
coefficient should be independent of the choice of the initial ensemble. The spreading of 
the distribution of sailors is then quantified by the growth of the mean square displacement 
in time. If this quantity grows linearly in time, which may not necessarily be the case but 
holds true if our probability distributions for the positions are Gaussian in the long-time 
limit [KlaOTb], the magnitude of the diffusion coefficient D tells us how quickly our ensemble 
of sailors disperses. For further details about a statistical physics description of diffusion 
we refer to the literature [Rci65]. 

In contrast to this well-known picture of diffusion as a stochastic random walk, the theory of 
dynamical systems makes it possible to treat diffusion as a deterministic dynamical process. 
Let us replace the sailor by a point particle. Instead of coin tossing, the orbit of such a 
particle starting at initial condition xq may then be generated by a chaotic dynamical system 
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of the type as considered in the previous chapters, x n+ \ = F(x n ). Note that defining the 
one-dimensional map F(x) together with this equation yields the full microscopic equations 
of motion of the system. You may think of these equations as a caricature of Newton's 
equations of motion modeling the diffusion of a single particle. Most importantly, in contrast 
to the drunken sailor with his memory loss after any time step here the complete memory of 
a particle is taken into account, that is, all steps are fully correlated. The decisive new fact 
that distinguishes this dynamical process from the one of a simple uncorrelated random walk 
is hence that x n+ i is uniquely determined by x n , rather than having a random distribution of 
x n+ i for a given x n . If the resulting dynamics of an ensemble of particles for given equations 
of motion has the property that a diffusion coefficient D > Eq. (3.1) exists, we speak of 
(normal) 1 deterministic diffusion [Dor99, Gas98, Kla07b, Kla96b, Sch89b]. 
Fig. 3.3 shows the simple model of deterministic diffusion that we shall study in this chapter. 
It depicts a "chain of boxes" of chain length L G N, which continues periodically in both 
directions to infinity, and the orbit of a moving point particle. Let us first specify the map 
defined on the unit interval, which we may call the box map. For this we choose the map 
B a (x) introduced in our previous Example 10. We can now periodically continue this box 
map onto the whole real line by a lift of degree one, 

B a {x + 1) = B a {x) + 1 , (3.3) 

for which the acronym old has been introduced [Kat95]. Physically speaking, this means 
that B a (x) continued onto the real line is translational invariant with respect to integers. 
Note furthermore that we have chosen a box map whose graph is point symmetric with 
respect to the center of the box at (x, y) = (0.5, 0.5). This implies that the graph of the full 
map B a (x) is anti-symmetric with respect to x = 0, 

B a (x) = -B a (-x) , (3.4) 

so that there is no "drift" in this chain of boxes. The drift case with broken symmetry could 
be studied as well [Kla07b], but we exclude it here for sake of simplicity. 

3.2 Escape rate formalism for deterministic diffusion 

Before we can start with this method, let us remind ourselves about the elementary theory 
of diffusion in form of the diffusion equation. We then outline the basic idea underlying the 
escape rate formalism, which eventually yields a simple formula expressing diffusion in terms 
of dynamical systems quantities. Finally, we work out this approach for our deterministic 
model introduced before. 

3.2.1 The diffusion equation 

In the last section we have sketched in a nutshell what, in our setting, we mean if we speak of 
diffusion. This picture is made more precise by deriving an equation that exactly generates 
the dynamics of the probability densities displayed in Fig. 3.2 [Rci65]. For this purpose, let 
us reconsider for a moment the situation depicted in Fig. 2.4. There, we had a gas with 



x See Section 4.1 for another type of diffusion, where D is either zero or infinite, which is called anomalous 
diffusion. 
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Figure 3.3: A simple model for deterministic diffusion. The dashed line depicts the orbit 
of a diffusing particle in form of a cobweb plot [A1197] . The slope a serves as a control 
parameter for the periodically continued piecewise linear map B a (x). 



an initially very high concentration of particles on the left hand side of the box. After the 
piston was removed, it seemed natural that the particles spread out over the right hand 
side of the box as well thus diffusively covering the whole box. We may thus come to the 
conclusion that, firstly, there will be diffusion if the density of particles in a substance is 
non-uniform in space. For this density of particles and by restricting ourselves to diffusion 
in one dimension in the following, let us write n = n(x,t), which holds for the number of 
particles that we can find in a small line element dx around the position x at time step t 
divided by the total number of particles N. 2 

As a second observation, we see that diffusion occurs in the direction of decreasing particle 
density. This may be expressed as 



,-of 

ox 



(3.5) 
which according to Einstein's formula Eq. (3.1) may be considered as a second definition of 



2 Note the fine distinction between h(x,i) and our previous p n {x), Eq.(2.33), in that here we consider 
continuous time t for the moment, and all our particles may interact with each other. 
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the diffusion coefficient D. Here the flux j = j(x, t) denotes the number of particles passing 
through an area perpendicular to the direction of diffusion per time t. This equation is 
known as Fick's first law. Finally, let us assume that no particles are created or destroyed 
during our diffusion process. In other words, we have conservation of the number of particles 
in form of 

f + I"» • ^ 

This continuity equation expresses the fact that whenever the particle density n changes in 
time t, it must be due to a spatial change in the particle flux j. Combining the equation 
with Fick's first law we obtain Fick's second law, 

which is also known as the diffusion equation. Mathematicians call the process defined by 
this equation a Wiener process, whereas physicists rather speak of Brownian motion. If we 
would now solve the diffusion equation for the drunken sailor initial density n(x, 0) = S(x), 
we would obtain the precise functional form of our spreading Gaussians in Fig. 3.2, 

fl(x ' t) = 7m exp {-i5i) ■ (3 - 8) 

Calculating the second moment of this distribution according to Eq. (3.2) would lead us 
to recover Einstein's definition of the diffusion coefficient Eq. (3.1). Therefore, both this 
definition and the one provided by Fick's first law are consistent with each other. 

3.2.2 Basic idea of the escape rate formalism 

We are now fully prepared for establishing an interesting link between dynamical systems 
theory and statistical mechanics. We start with a brief outline of the concept of this theory, 
which is called the escape rate formalism, pioneered by Gaspard and others [Gas90, Gas98, 
Dor99]. It consists of three steps: 

Step 1: Solve the one- dimensional diffusion equation Eq. (3.7) derived above for absorbing 
boundary conditions. That is, we consider now some type of open system similar to what we 
have studied in the previous chapter. We may thus expect that the total number of particles 
N(t) := J dxn(x,t) within the system decreases exponentially as time evolves according to 
the law expressed by Eq. (2.40), that is, 

N(t) = 7V(0)e- 7det . (3.9) 

It will turn out that the escape rate jde defined by the diffusion equation with absorbing 
boundaries is a function of the system size L and of the diffusion coefficient D. 
Step 2: Solve the Frobenius- Perron equation 

p n+ i(x)= dyp n (y)6(x-F(y)) , (3.10) 

which represents the continuity equation for the probability density p n (x) of the map F(x) 
[Ott93, Bec93, Dor99], for the very same absorbing boundary conditions as in Step 1. Let us 
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assume that the dynamical system under consideration is normal diffusive, that is, that a 
diffusion coefficient D > exists. We may then expect a decrease in the number of particles 
that is completely analogous to what we have obtained from the diffusion equation. That 
is, if we define as before N n := J dxp n (x) as the total number of particles within the system 
at discrete time step n, in case of normal diffusion we should obtain 

N n = N e^ Fpn . (3.11) 

However, in contrast to Step 1 here the escape rate 'jpp should be fully determined by the 
dynamical system that we are considering. In fact, we have already seen before that for 
open systems the escape rate can be expressed exactly as the difference between the positive 
Ljapunov exponent and the KS-entropy on the fractal repeller, cf. the escape rate formula 
Eq. (2.51). 

Step 3: If the functional forms of the particle density n(x, t) of the diffusion equation and 
of the probability density p n (x) of the map's Frobenius- Perron equation match in the limit 
of system size and time going to infinity — which is what one has to show — , the escape 
rates 'jde obtained from the diffusion equation and 'Jfp calculated from the Frobenius- Perron 
equation should be equal, 

Ide = 1FP , (3.12) 

providing a fundamental link between the statistical physical theory of diffusion and dy- 
namical systems theory. Since ^de is a function of the diffusion coefficient D, and knowing 
that 'Jfp is a function of dynamical systems quantities, we should then be able to express 
D exactly in terms of these dynamical systems quantifiers. We will now illustrate how this 
method works by applying it to our simple deterministic diffusive model introduced above. 

3.2.3 The escape rate formalism worked out for a simple map 

Let us consider the map B a (x) lifted onto the whole real line for the specific parameter value 

a = 4, see Fig. 3.4. With L we denote the chain length. Proceeding along the above lines, 

let us start with 

Step 1: Solve the one-dimensional diffusion equation Eq. (3.7) for the absorbing boundary 

conditions 

n(0, t) = n(L, t) = , (3.13) 

which models the situation that particles escape precisely at the boundaries of our one- 
dimensional domain. A straightforward calculation yields 



nix 



v-^ , / /rmx\ 2 \ /mil \ 

t) = Ys b ™ ex V{-{— ) Dt ) sin i^—xj (3.14) 

m=l ^ ' 



with b m denoting the Fourier coefficients. 

Step 2: Solve the Frobenius-Perron equation Eq. (3.10) for the same absorbing boundary 

conditions, 

p n (0) = p n (L) = . (3.15) 

In order to do so, we first need to introduce a concept called Markov partition for our map 
BAx): 
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B 4 (x) 4 




Figure 3.4: Our previous map B a (x) periodically continued onto the whole real line for the 
specific parameter value a = 4. The example shown depicts a chain of length L = 3. The 
dashed quadratic grid indicates a Markov partition for this map. 



Definition 11 Markov partition, verbally [Bec93, KlaOla] 

For one- dimensional maps acting on compact intervals a partition is called Markov if parts 

of the partition get mapped again onto parts of the partition, or onto unions of parts of the 

partition. 

Example 13 The dashed quadratic grid in Fig. 3.4 defines a Markov partition for the lifted 
map B±{x). 

Of course there also exists a precise formal definition of Markov partitions, however, here 
we do not elaborate on these technical details [Kla07a]. Having a Markov partition at hand 
enables us to rewrite the Frobenius-Perron equation in form of a matrix equation, where a 
Frobenius- Perron matrix operator acts onto probability density vectors defined with respect 
to this special partitioning. 3 In order to see this, consider an initial density of points that 
covers, e.g., the interval in the second box of Fig. 3.4 uniformly. By applying the map onto 
this density, one observes that points of this interval get mapped two-fold onto the interval 
in the second box again, but that there is also escape from this box which uniformly covers 
the third and the first box intervals, respectively. This mechanism applies to any box in 
our chain of boxes, modified only by the absorbing boundary conditions at the ends of the 



3 Implicitly we herewith choose a specific space of functions, which are tailored for studying the statistical 
dynamics of our piecewise linear maps; see [Jen04] for mathematical details on this type of methods. 



3.2 Escape rate formalism for deterministic diffusion 



27 



chain of length L. Taking into account the stretching of the density by the slope a = 4 at 
each iteration, this suggests that the Frobenius-Perron equation Eq. (3.10) can be rewritten 
as 

(3.16) 



Pn+i = l T{A) p n 
where the L x L-transition matrix T(4) must read 
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(3.17) 



Note that in any row and in any column we have three non-zero matrix elements except 
in the very first and the very last rows and columns, which reflect the absorbing bound- 
ary conditions. In Eq.(3.16) this transition matrix T(4) is applied to a column vector p n 
corresponding to the probability density p n (x), which can be written as 



\p n (x) >:= (pl,p 2 n , ...,Pn, ■■■,Pn) 



L\ * 



(3.18) 



where "*" denotes the transpose and p k n represents the component of the probability density 
in the fcth box, p n (x) = p k n , k — 1 < x < k , k = 1, . . . , L , p\ being constant on each part of 
the partition. We see that this transition matrix is symmetric, hence it can be diagonalized 
by spectral decomposition. Solving the eigenvalue problem 



where Xm(4) and 
obtains 



T(4) \<p m {x) >= xm(4) \(t> m (x) > , (3.19) 

(x) > are the eigenvalues and eigenvectors of T(4), respectively, one 



1 L 

\p n (x) > = - 2^ Xm(4) \<fim(x) >< <j>m{x) \p n -l{x) > 
m=l 

m=l V XmKVJ 



(3.20) 



where |po(^) > is the initial probability density vector. Note that the choice of initial 
probability densities is restricted by this method to functions that can be written in the 
vector form of Eq.(3.18). It remains to solve the eigenvalue problem Eq. (3.19) [Kla95, 
Kla99]. The eigenvalue equation for the single components of the matrix T(4) reads 



L.k+2 



supplemented by the absorbing boundary conditions 

. 



in 



LL+l 

III 



(3.21) 



(3.22) 
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This equation is of the form of a discretized ordinary differential equation of degree two, 
hence we make the ansatz 

4> k m = a cos{k9) + b sm(k9) , < k < L + 1 . (3.23) 

The two boundary conditions lead to 

a = and sin((L + 1)0) = (3.24) 

yielding 

7717T 

The eigenvectors are then determined by 

<P k m = bsm(k9 rn ) . (3.26) 

Combining this equation with Eq. (3.21) yields as the eigenvalues 

X m = 2 + 2cos0 m . (3.27) 

Step 3: Putting all details together, it remains to match the solution of the diffusion 
equation to the one of the Frobenius- Perron equation: In the limit of time t and system size 
L to infinity, the density n(x,t) Eq. (3.14) of the diffusion equation reduces to the largest 
eigenmode, 

n(x, t) ~ exp (-jdet) B sin ( — x) , (3.28) 

where 

7de :=(£) 2 J D (3.29) 

defines the escape rate as determined by the diffusion equation. Analogously, for discrete 
time n and chain length L to infinity we obtain for the probability density of the Frobenius- 
Perron equation, Eq.(3.20) with Eq.(3.26), 

p n (x) ~ exp (-iFpn) B sin I — — k 

k = 0,...,L + l , k-l<x<k (3.30) 

with an escape rate of this dynamical system given by 

7 ^ = ln 2 + 2cos('/(L + l)) ' (3 ' 31) 

which is determined by the largest eigenvalue \i °f t ne niatrix T(4), see Eq.(3.20) with 
Eq.(3.27). We can now see that the functional forms of the eigenmodes of Eqs.(3.28) and 
(3.30) match precisely 4 This allows us to match Eqs. (3.29) and (3.31) leading to 

D(4) = f^\ lFP . (3.32) 



4 We remark that there are discretization effects in the time and position variables, which are due to the 
fact that we compare a time-discrete system defined on a specific partition with time-continuous dynamics. 
They disappear in the limit of time to infinity by using a suitable spatial coarse graining. 



Using the right hand side of Eq. (3.31) and expanding it for L —* oo, this formula enables 
us to calculate the diffusion coefficient D(A) to 

D(4) = g) ' 1FP = i^^jj + 0(i" 4 ) - j (i - oo) . (3.33) 

Thus we have developed a method by which we can exactly calculate the deterministic 
diffusion coefficient of a simple chaotic dynamical system. However, more importantly, 
instead of using the explicit expression for jpp given by Eq. (3.31), let us remind ourselves 
of the escape rate formula Eq. (2.51) for ^fp, 

Iff = i{C Ba ) = \{C Bi ) - h KS (C Bi ) , (3.34) 

which more geneally expresses this escape rate in terms of dynamical systems quantities. 
Combining this equation with the above equation Eq. (3.32) leads to our final result, the 
escape rate formula for deterministic diffusion [Gas90, Gas98] 

£>(4) = lim ( -) [X(C B4 ) - h KS (C B J] . (3.35) 

We have thus established a fundamental link between quantities assessing the chaotic prop- 
erties of dynamical systems and the statistical physical property of diffusion. 

Remark 3 

1. Above we have only considered the special case of the control parameter a = 4. Along 
the same lines, the diffusion coefficient can be calculated for other parameter values 
of the map B a (x). Surprisingly, the parameter-dependent diffusion coefficient of this 
map turns out to be a fractal function of the control parameter [Kla95, Kla96b, Kla99]. 
This result is believed to hold for a wide class of dynamical systems [Kla07b]. 

2. The escape rate formula for diffusion does not only hold for simple one-dimensional 
maps but can be generalized to higher- dimensional time-discrete as well as time- 
continuous dynamical systems [Gas98, Dor99]. 

3. This approach can also be generalized to establish relations between chaos and trans- 
port for other transport coefficients such as viscosity, heat conduction and chemical 
reaction rates [Gas98]. 

4. This is not the only approach connecting transport properties with dynamical systems 
quantities. In recent research it was found that there exist at least two other ways 
to establish relations that are different but of a very similar nature; see [Kla07b] for 
further details. 



Anomalous diffusion 



In the last section we have explored diffusion for a simple piecewise linear map. One may 
now wonder what type of diffusive behavior is encountered if we consider more complicated 
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P 0.5 




Figure 4.1: The Pomeau-Manneville map Eq. (4.1) for a = 1 and z = 3. Note that there is 
a marginal fixed point at x = leading to the intermittent behavior depicted in Fig. 4.2. 

models. Straightforward generalizations are nonlinear maps generating intermittency. In 
Section 4.1 we briefly illustrate the phenomenon of intermittency and introduce the concept 
of anomalous diffusion. We then give an outline of continuous time random walk theory, 
which is a powerful tool of stochastic theory that models anomalous diffusion. By using this 
method we derive a fractional diffusion equation, which generalizes Fick's second law that 
we have encountered before to this type of anomalous diffusion. 

After having restricted ourselves to rather abstract but mostly solvable models, we conclude 
our review by discussing an experiment which gives evidence for the existence of anomalous 
diffusion in a fundamental biological process. Section 4.2 first motivates the problem of 
cell migration. We then present experimental results for two different cell types and explain 
them by suggesting a model reproducing the observed anomalous dynamics of cell migration. 
Section 4.1 particularly draws on Refs. [Kor05, Kor07], see also Section 6.2 of [Kla07b], 
Section 4.2 is based on Ref. [Die08]. For more general introductions to the very active field 
of anomalous transport see, e.g., Refs. [Shl93, Kla96a, MetOO, Kla08]. 



4.1 Anomalous diffusion in intermittent maps 

4.1.1 What is anomalous diffusion? 

Let us consider a simple variant of our previous piecewise linear model, which is the Pomeau- 
Manneville map [Pom80] 

P a ,z( x ) — x + ax z modi , (4.1) 

see Fig. 4.1, where as usual the dynamics is defined by x n+ i = P a)Z (x n ). This map has two 
control parameters, a > 1 and the exponent of nonlinearity z > 1. For a = 1 and z = 1 this 
map just reduces to our familiar Bernoulli shift Eq. (2.3), however, for z > 1 it provides a 
nontrivial nonlinear generalization of it. The nontriviality is due to the fact that in this case 
the stability of the fixed point at x = becomes marginal (sometimes also called indifferent, 
or neutral), P^ z (0) = 1. Since the map is smooth around x = 0, the dynamics resulting 
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Figure 4.2: Phenomenology of intermittency in the Pomeau-Manneville map Fig. 4.1: The 
plot shows the time series of position x n versus discrete time step n for an orbit generated 
by the map Eq. (4.1), which starts at a typical initial condition xq. 

from the left branch of the map is determined by the stability of this fixed point, whereas 
the right branch is just of Bernoulli shift-type yielding ordinary chaotic dynamics. There is 
thus a competition in the dynamics between these two different branches as illustrated by 
Fig. 4.2: One can observe that long periodic laminar phases determined by the marginal 
fixed point around x = are interrupted by chaotic bursts reflecting the "Bernoulli shift-like 
part" of the map with slope a > 1 around x — 1. This phenomenology is the hallmark of 
what is called intermittency [Sch89b, Ott93]. 

Following Section 3.1 it is now straightforward to define a spatially extended version of 
the Pomeau-Manneville map: For this purpose we just continue P a ,z(x) = x + ax z , < 
x < | in Eq. (4.1) onto the real line by the translation P a>z ( x + 1) — Pa,z( x ) + 1> see 
Eq. (3.3), under reflection symmetry P a ,z(~ x) = —P a , z {x), see Eq. (3.4). The resulting 
model [Gci84, Zum93] is displayed in Fig. 4.3. As before, we may now be interested in 
the type of deterministic diffusion generated by this model. Surprisingly, by calculating the 
mean square displacement Eq. (3.2) either analytically or from computer simulations one 
finds that for z > 2 



<* 2 > 



~ n 



a < 1 



[n 



oo 



(4.2) 



This implies that the diffusion coefficient D := linv^oo < x 2 > /(2n) as defined by Eq. (3.1) 
is simply zero, despite the fact that particles can go anywhere on the real line as shown in 
Fig. 4.3. We thus encounter a novel type of diffusive behavior classified by the following 
definition: 



Definition 12 anomalous diffusion [MetOO, Kla08] 

If the exponent a in the temporal spreading of the mean square displacement Eq. (4-2) of an 
ensemble of particles is not equal to one, one speaks of anomalous diffusion. If a < 1 one 
says that there is subdiffusion, for a > 1 there is superdiffusion, and in case of a = 1 one 
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Figure 4.3: The Pomeau-Manneville map Fig. 4.1, Eq. (4.1), lifted symmetrically onto the 
whole real line such that it generates subdiffusion. 



refers to normal diffusion. The constant 



K 



lim 

n— >oo 



< X z > 



IV 



(4.3) 



where in case of normal diffusion K = 2D, is called the generalized diffusion coefficient. 1 

We will now discuss how K behaves as a function of a for our new model and then show 
how the exponent a and, in an approximation, K, can be calculated analytically. This 
can be achieved by means of continuous time random walk (CTRW) theory, which pro- 
vides a generalization of the drunken sailor's model introduced in Section 3.1 to anomalous 
dynamics. 



4.1.2 Continuous time random walk theory 

Let us first study the diffusive behavior of the map displayed in Fig. 4.3 by computer 
simulations. 2 As we will explain in detail below, stochastic theory predicts that for this 



1 In detail, the definition of a generalized diffusion coefficient is a bit more subtle [Kor07]. 
2 A11 simulations were performed starting from a uniform, random distribution of 10 6 initial conditions 
on the unit interval by iterating for n = 10 4 time steps. 
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Figure 4.4: The generalized diffusion coefficient K Eq. (4.3) as a function of a for z = 3. The 
curve in (a) consists of 1200 points, the dashed-dotted line displays the CTRW result Kx, 
Eqs. (4.14), (4.16). (b) (600 points) and (c) (200 points) show magnifications of (a) close to 
the onset of diffusion. The dotted line in (b) is the CTRW approximation K 2 , Eqs. (4.15), 
(4.16), the dashed line represents yet another semi-analytical approximation as detailed in 
Refs. [Kor05, Kor07]. The triangles mark a specific structure appearing on finer and finer 
scales. The inset in (a) depicts again the model Eq. (4.1). 



map it is 



a = 



1 < z <2 




(4.4) 



[Gei84, Zum93]. For all values of the second control parameter a we indeed find excellent 
agreement between these analytical solutions and the results for a obtained from simulations. 
Consequently, a is determined by Eq. (4.4) in the following for extracting the generalized 
diffusion coefficient K Eq. (4.3) from simulations. 

While in Chapter 3 we have only discussed diffusion for a specific choice of the control 
parameter, we now study the behavior of K as a function of a for fixed z. Computer 
simulation results are displayed in Fig. 4.4. Magnifications of part (a) shown in parts (b) 
and (c) reveal self similar-like irregularities indicating a fractal parameter dependence of K = 
K(a). This fractality is highlighted by the sub-structure identified through triangles, which 
is repeated on finer and finer scales. The parameter values for these symbols correspond to 
specific series of Markov partitions. Details are explained in Refs. [Kla95, Kla96b, Kla99] 
for parameter-dependent diffusion in the piecewise linear one-dimensional maps studied 
in Chapter 3, which exhibits quite analogous structures. Over the past few years such 
fractal transport coefficients have been revealed for a number of different models. They 
are conjectured to be a typical phenomenon if the dynamical system is deterministic, low- 
dimensional and spatially periodic. Their origin can be understood in terms of microscopic 
long-range dynamical correlations that, due to topological instabilities of dynamical systems, 
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change in a complicated manner under parameter variation. Although it has been argued 
that such highly irregular behavior of transport coefficients should also occur in physically 
realistic systems, it has not yet clearly been observed in experiments; see Ref. [Kla07b] for 
a review of this line of research. 

Instead of elaborating on the fractality in detail, here we reproduce the course functional 
form of K(a) by using stochastic CTRW theory. Pioneered by Montroll, Weiss and Scher 
[Mon65, Mon73, Sch75], it yields perhaps the most fundamental theoretical approach to 
explain anomalous diffusion [Bou90, Wci94, Ebe05]. In further groundbreaking works by 
Geisel et al. and Klafter et al., this method was then adapted to sub- and superdiffusive 
deterministic maps [Gei84, Gei85, Shl85, Zum93] 

The basic assumption of the approach is that diffusion can be decomposed into two stochas- 
tic processes characterized by waiting times and jumps, respectively. Thus one has two 
sequences of independent identically distributed random variables, namely a sequence of 
positive random waiting times Ti,T2,T^, . . . with probability density function w(t) and a 
sequence of random jumps Ci, C2, C3; • • • with a probability density function A(x). For exam- 
ple, if a particle starts at point x = at time t = and makes a jump of length ( n at time 
t n = Ti + T 2 + ... + T n , its position is x = for < t < T\ = t t and x = Ci + C2 + ••• + d f° r 
tn < t < t n+ i. The probability that at least one jump is performed within the time interval 
[0, t) is then J dt'w(t ; ) while the probability for no jump during this time interval reads 
\I/(t) = 1 — f dt'w{t'). The master equation for the probability density function P(x,t) to 
find a particle at position x and time t is then 

/OO [*t 

dx'X(x - x') I dt' w(t - f) P(x', t') + tf(t)6(x) . (4.5) 

-00 Jo 

It has the following probabilistic meaning: The probability density function to find a particle 
at position x at time t is equal to the probability density function to find it at point x' at 
some previous time t' multiplied with the transition probability to get from (x f , t') to (x, t) 
integrated over all possible values of x' and t' '. The second term accounts for the probability 
of remaining at the initial position x = 0. The most convenient representation of this 
equation is obtained in terms of the Fourier-Laplace transform of the probability density 
function, 

poo poo 

ikx I j± „—st 



P(k,s)= dxe lkx dte- st P(x,t) , (4.6) 

J-00 Jo 

where the hat stands for the Fourier transform and the tilde for the Laplace transform. 
Respectively, this function obeys the Fourier-Laplace transform of Eq. (4.5), which is called 
the Montroll- Weiss equation [Mon65, Mon73, Sch75], 

P(*,.) = IZ£<!> — ' . (4.7) 

s l-\(k)w{s) 

The Laplace transform of the mean square displacement can be readily obtained by differ- 
entiating the Fourier-Laplace transform of the probability density function, 



d 2 P(k 
(x 2 (s)) =■ I dx x 2 P(x, s) = - 



dk 



2 



(4.8) 

fc=0 



In order to calculate the mean square displacement within this theory, it thus suffices to 
know A (2) and w(t) generating the stochastic process. For one-dimensional maps of the 
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type of Eq. (4.1), exploiting the symmetry of the map the waiting time distribution can be 
calculated from the approximation 

dxt 
x n+1 - x n ~ — = ax t , x < 1 , (4.9) 

where we have introduced the continuous time t > 0. This equation can easily be solved for 
x t with respect to an initial condition xq. Now one needs to define when a particle makes a 
"jump", as will be discussed below. By inverting the solution for xt, one can then calculate 
the time t a particle has to wait before it makes a jump as a function of the initial condition 
Xq. This information determines the relation between the waiting time probability density 
w(t) and the as yet unknown probability density of injection points, 



W(t) ~ Pin(x ) 



dxo 



dt 



(4.10) 



Making the assumption that the probability density of injection points is uniform, P in ~ 1, 
the waiting time probability density is straightforwardly calculated from the knowledge of 
t(x ). The second ingredient that is needed for the CTRW approach is the jump probability 
density. Standard CTRW theory takes jumps between neighbouring cells only into account 
leading to the ansatz [Gei84, Zum93] 

A(x) = S(\x\ - 1) . (4.11) 

It turns out that a correct application of this theory to our results for K(a) requires a 
modification of the standard theory at three points: Firstly, the waiting time probability 
density function must be calculated according to the grid of elementary cells indicated in 
Fig. 4.4 [Kla96b, Kla97] yielding 

w(t) = a(l + a(z-l)t)~^ . (4.12) 

However, this probability density function also accounts for attempted jumps to another cell, 
since after a step the particle may stay in the same cell with a probability of (1 — p). The 
latter quantity is roughly determined by the size of the escape region p — (1 — 2x c ) with x c 
as a solution of the equation x c + ax z c = 1. We thus model this fact, secondly, by a jump 
length distribution in the form of 

\( x ) = l5(\x\-l) + (l-p)6(x). (4.13) 

Thirdly, we introduce two definitions of a typical jump length lj,iG {1, 2}. 

h = {\M a>z (x)-x\} (4.14) 

corresponds to the actual mean displacement while 

h = {\[M a , z {x)\\) (4.15) 

gives the coarse-grained displacement in units of elementary cells, as it is often assumed in 
CTRW approaches. In these definitions {. . .} denotes both a time and ensemble average 
over particles leaving a box. Working out the modified CTRW approximation sketched 
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above by taking these three changes into account we obtain for the generalized diffusion 
coefficient 

;2 \ a 7 sin(7T7)/7T7 1+7 , < 7 < f 



K i =plj{ ,° \ '( ' 1/ , (4.16) 

F * \ a(l - I/7) , 1 < 7 < 00 y ' 

where 7 := l/(z — 1), which for z > 2 is identical with a defined in Eq. (4.4). Fig. 4.4 (a) 
shows that K\ well describes the coarse functional form of K for large a. K 2 is depicted 
in Fig. 4.4 (b) by the dotted line and is asymptotically exact in the limit of very small 
a. Hence, the generalized diffusion coefficient exhibits a dynamical crossover between two 
different coarse grained functional forms for small and large a, respectively. An analogous 
crossover has been reported earlier for normal diffusion [Kla96b, Kla97] and was also found 
in other models [Kla07b]. 

Let us finally focus on the generalized diffusion coefficient at a = 12,20,28, ..., which cor- 
respond to integer values of the height h = [M a>z (l/2)] of the map. Simulations reproduce, 
within numerical accuracy, the results for K 2 by indicating that K is discontinuous at these 
parameter values. Due to the self similar-like structure of the generalized diffusion coef- 
ficient it was thus conjectured that the precise K of our model exhibits infinitely many 
discontinuities on fine scales as a function of a, which is at variance with the continuity of 
the CTRW approximation [Kor05, Kor07]. This highlights again that CTRW theory gives 
only an approximate solution for the generalized diffusion coefficient of this model. 

4.1.3 A fractional diffusion equation 

We now turn to the probability density functions (PDFs) generated by the map Eq. (4.1). 
As we will show now, CTRW theory not only predicts the power 7 correctly but also the 
form of the coarse grained PDF P(x, t) of displacements. Correspondingly the anomalous 
diffusion process generated by our model is not described by an ordinary diffusion equation 
but by a generalization of it. Starting from the Mo ntroll- Weiss equation and making use of 
the expressions for the jump and waiting time PDFs Eqs. (4.11), (4.12), we rewrite Eq. (4.7) 
in the long-time and -space asymptotic form 

2cbi v ; 

with c = T(l — 7) and b = 7/0. For the initial condition P(x, 0) = 5(x) of the PDF we have 
P(k,0) = 1. Interestingly, the left hand side of this equation corresponds to the definition 
of the Caputo fractional derivative of a function G, 



d^G 
in Laplace space [Pod99, Mai97], 



1 rt f)/~< 



8" f G 
dt e- st ^ = 8iG{s) - 8^0(0) . (4.19) 

Thus, fractional derivatives come naturally into play as a suitable mathematical formalism 
whenever there are power law memory kernels in space and/or time generating anomalous 
dynamics; see, e.g., Refs. [Sok02, MetOO] for short introductions to fractional derivatives 
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Figure 4.5: Comparison of the probability density obtained from simulations of the map 
Eq. (4.1) (oscillatory structure) with the analytical solution Eq. (4.21) of the fractional 
diffusion equation Eq. (4.20) (continuous line in the middle) for z = 3 and a = 8. The 
probability density was computed from 10 7 particles after n = 10 3 iterations. For the 
generalized diffusion coefficient in Eq. (4.21) the simulation result was used. The crosses 
represent the numerical results coarse grained over unit intervals. The upper and the 



x 



lower curves correspond to fits with a stretched exponential and a Gaussian distribution, 
respectively. The inset depicts the probability density function for the map on the unit 
interval with periodic boundaries. 



and Ref. [Pod99] for a detailed exposition. Turning back now to real space, we thus arrive 
at the time-fractional diffusion equation 



dnp{x,t) 



D 



d 2 p 

dx 2 



(4.20) 



with D = KF(1 + 7)/2, < 7 < 1, which is an example of a fractional diffusion equation 
generating subdiffusion. For 7 = 1 we recover the ordinary diffusion equation. The solution 
of Eq. (4.20) can be expressed in terms of an M-function of Wright type [Mai97] and reads 



P{x,t) 



2VDt"// 2 ' 



-M 



(«■ 



(4.21) 



Fig. 4.5 demonstrates an excellent agreement between the analytical solution Eq. (4.21) 
and the PDF obtained from simulations of the map Eq. (4.1) if the PDF is coarse grained 
over unit intervals. However, it also shows that the coarse graining eliminates a periodic 
fine structure that is not captured by Eq. (4.21). This fine structure derives from the 
"microscopic" PDF of an elementary cell (with periodic boundaries) as represented in the 
inset of Fig. 4.5 [Kla96b]. The singularities are due to the marginal fixed points of the map, 
where particles are trapped for long times. Remarkably, that way the microscopic origin 
of the intermittent dynamics is reflected in the shape of the PDF on the whole real line: 
From Fig. 4.5 it is seen that the oscillations in the PDF are bounded by two functions, the 
upper curve being of a stretched exponential type while the lower is Gaussian. These two 
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Figure 4.6: Trajectories of three colloidal particles of radius 0.53/im whose positions have 
been measured experimentally every 30 seconds. Single points are joined by straight lines 
[Per09]. 

envelopes correspond to the laminar and chaotic parts of the motion, respectively 3 

4.2 Anomalous diffusion of migrating biological cells 

4.2.1 Cell migration 

We start this final section with results from a famous experiment. Fig. 4.6 shows the 
trajectories of three colloidal particles immersed in a fluid. Their motion looks highly 
irregular thus reminding us of the trajectory of the drunken sailor's problem displayed in 
Fig. 3.1. As we discussed in Chapter 3, dynamics which can be characterized by a normal 
diffusion coefficient is called Brownian motion. It was Einstein's achievement to understand 
the diffusion of molecules in a fluid in terms of such microscopic dynamics [Ein05]. His 
theory actually motivated Perrin to conduct his experiment by which Einstein's theory was 
confirmed [Pcr09]. 

Fig. 4.7 now shows the trajectory of a very different type of process. Displayed is the path 
of a single biological cell crawling on a substrate [Dic08]. Nearly all cells in the human 
body are mobile at a given time during their life cycle. Embryogenesis, wound-healing, 
immune defense and the formation of tumor metastases are well known phenomena that 
rely on cell migration. If one compares the cell trajectory with the one of the Brownian 
particles depicted in Fig. 4.6, one may find it hard to see a fundamental difference. On 
the other hand, according to Einstein's theory a Brownian particle is passively driven by 
collisions from the surrounding particles, whereas biological cells move actively by themselves 
converting chemical into kinetic energy. This raises the question whether the dynamics of 



3 The two envelopes shown in Fig. 4.5 represent fits with the Gaussian aoexp(— x 2 /a\) and with the 
M-function b Q M(\x\ /bi, ^), where a = 0.0036, ai = 55.0183 and b = 3.05, bi = 0.37. 
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Figure 4.7: Overlay of a biological cell migrating on a substrate. The cell frequently changes 
its shape and direction during migration, as is shown by several cell contours extracted 
during the migration process. The inset displays phase contrast images of the cell at the 
beginning and to the end of its migration process [Dic08] . 

cell migration can really be understood in terms of Brownian motion [Dun87, Sto91] or 
whether more advanced concepts of dynamical modeling have to be applied [Har94, UpaOl]. 



4.2.2 Experimental results 

The cell migration experiments that we now discuss have been performed on two transformed 
renal epithelial Madin Darby canine kidney (MDCK-F) cell strains: wild-type (NHE + ) and 
NHE-deficient (NHE~) cells. 4 The cell diameter is typically 20-50/mi and the mean velocity 
of the cells about 1/im/min. The lamellipodial dynamics, which denotes the fluctuations of 
the cell body surrounding the cell nucleus, called cytoskeleton, that drives the cell migration, 
is of the order of seconds. Thirteen cells were observed for up to 1000 minutes. Sequences of 
microscopic phase contrast images were taken and segmented to obtain the cell boundaries 
shown in Fig. 4.7; see Ref. [Die08] for full details of the experiment. 

As we have learned in Chapter 3, Brownian motion is characterized by a mean square 
displacement (msd) proportional to t in the limit of long time designating normal diffusion. 
Fig. 4.8 shows that both types of cells behave differently: First of all, MDCK-F NHE~ 
cells move less efficiently than NHE + cells resulting in a reduced msd for all times. As is 
displayed in the upper part of this figure, the msd of both cell types exhibits a crossover 
between three different dynamical regimes. These phases can be best identified by extracting 
the time-dependent exponent j3 of the msd ~ t" from the data, which can be done by using 



A NHE + stands for a molecular sodium hydrogen emitter that either is present or has been blocked by 
chemicals, which is supposed to have an influence on cell migration [Die08]. 
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Figure 4.8: Upper part: Double-logarithmic plot of the mean square displacement (msd) 
as a function of time. Experimental data points for both cell types are shown by symbols. 
Different time scales are marked as phases I, II and III as discussed in the text. The solid 
lines represent fits to the msd from the solution of our model, see Eq. (4.28). All parameter 
values of the model are given in [Dic08]. The dashed lines indicate the uncertainties of the 
msd values according to Bayes data analysis. Lower part: Logarithmic derivative j3(t) of 
the msd for both cell types. 



the logarithmic derivative 



P(t) 



dmmsd(t) 
dint 



(4.22) 



The results are shown in the lower part of Fig. 4.8. Phase I is characterized by an expo- 
nent (3{t) roughly below 1.8. In the subsequent intermediate phase II, the msd reaches its 
strongest increase with a maximum exponent (3. When the cell has approximately moved 
beyond a square distance larger than its own mean square radius (indicated by arrows in 
the figure), /3(t) gradually decreases to about 1.4. Both cell types therefore do not exhibit 
normal diffusion, which would be characterized by (3{t) —* 1 for large times, but move 
anomalously, where the exponent j3 > 1 indicates superdiffusion. 

We next show the probability that the cells reach a given position x at time t, which 
corresponds to the temporal development of the spatial probability distribution function 
P(x,t). Fig. 4.9 (a), (b) reveals the existence of non-Gaussian distributions at different 
times. The transition from a peaked distribution at short times to rather broad distributions 
at long times suggests again the existence of distinct dynamical processes acting on different 
time scales. The shape of these distributions can be quantified by calculating the kurtosis 



K (t) :- 



< x\t) > 

< x 2 {t) > 2 



(4.23) 



which is displayed as a function of time in Fig. 4.9 (c). For both cell types n(t) rapidly 
decays to a constant clearly below three in the long time limit. A value of three would be 
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Figure 4.9: Spatio-temporal probability distributions P(x,t). (a),(b): Experimental data for 
both cell types at different times in semilogarithmic representation. The dark lines, labeled 
FKK, show the solutions of our model Eq. (4.24) with the same parameter set used for the 
msd fit. The light lines, labeled OU, depict fits by Gaussian distributions representing the 
theory of Brownian motion. For t = lmin both P(x, t) show a peaked structure clearly 
deviating from a Gaussian form, (c) The kurtosis n(t) of P(x,t), plotted as a function of 
time, saturates at a value different from the one of Brownian motion (line at k = 3). The 
other two lines represent n(t) obtained from our model Eq. (4.24) [Die08]. 



the result for the spreading Gaussian distributions of the drunken sailor. These findings are 
another strong manifestation of the anomalous nature of cell migration. 



4.2.3 Theoretical modeling 

We conclude this section with a short discussion of the stochastic model that we have used 
to fit the experimental data, as was shown in the previous two figures. The model is defined 
by the fractional Klein- Kramers equation [BarOO] 



dP 

~dt 
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dx 
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Here P = P(x, v, t) is the probability distribution depending on time t, position x and 
velocity v in one dimension, 5 7 is a damping term and v t h = ksT /M stands for the ther- 
mal velocity of a particle of mass M at temperature T, where k% is Boltzmann's constant. 
The last term in this equation models diffusion in velocity space, that is, in contrast to 
the drunken sailors problem here the velocity is not constant but also randomly distributed 
according to a probability density, which is determined by this equation. Additionally, and 
again in difference to the simple diffusion equation that we have encountered in Section 3.2.1, 
this equation features two flux terms both in velocity and in position space, see the second 
and the first term in this equation, respectively. What distinguishes this equation from 
an ordinary Klein-Kramers equation, which actually is the most general model of Brown- 
ian motion in position and velocity space [Ris96], is the presence of a Riemann-Liouville 
fractional derivative of order (1 — a) in front of the last two terms defined by 

d 5 P \%£ , 5 = m 

(4.25) 
m — 1 < < m 



pus -~ ) &0L 1 r f m P(f) 
[ dt™ r(m-s) Jo ah {t-t>y+ 1 - 

with m G N. Note that for a = 1 the ordinary Klein-Kramers equation is recovered. The 
analytical solution of this equation for the msd has been calculated in Ref. [BarOO] to 

msd{t) = 2v 2 th t 2 E a ^-Kt a ) -h. 2 ^ a (t-00) (4.26) 

1 (S — a) 

with D a = 1^/7 an d the generalized Mittag-Leffter function 

00 y. 



fc=0 



T(ak + /3) 



Note that Ei t i(z) = exp(z), hence E a ^(z) is a generalized exponential function. We see 
that for long times Eq. (4.26) yields a power law, which reduces to the Brownian motion 
result in case of a = 1. The analytical solution of Eq. (4.24) for P(x,v,t) is not known, 
however, for large friction 7 this equation boils down to a fractional diffusion equation for 
which P(x,t) can be calculated in terms of a Fox function [Sch89a]. This solution is what 
we have used to fit the data. Our modeling is completed by adding what may be called 
"biological noise" to Eq. (4.26), 

msd noise (t) := msd(t) + 2n 2 . (4.28) 

This uncorrelated white noise of variance rj 2 mimicks both measurement errors and fluctua- 
tions of the cell cytoskeleton. The strength of this noise as extracted from the experimental 
data is larger than the measurement error and determines the dynamics at small time scales, 
therefore here we see microscopic fluctuations of the cell body in the experiment. The ex- 
perimental data in Figs. 4.8, 4.9 was then consistently fitted by using the four fit parameters 
v t h, ctil and rf in Bayesian data analysis [Dic08]. 

We consider this model as an interesting illustration of the usefulness of stochastic fractional 
equations in order to understand real experimental data displaying anomalous dynamics. 



5 No correlations between x and y direction could be found, hence the model is only one dimensional 
[Die08]. 



However, the reader may still wonder about the physical and biological interpretation of the 
above equation for cell migration. First of all, it can be argued that the fractional Klein- 
Kramers equation is approximately 6 related to the generalized Langevin equation [LutOl] 

dt' ^t - t')v(t') + ^ i(t) . (4.29) 

This equation can be understood as a stochastic version of Newton's law: The left hand 
side holds for the acceleration of a particle, whereas the total force acting onto it is decom- 
posed into a friction term and a random force. The latter is modeled by Gaussian white 
noise £(£) of strength \/T,, and the friction coefficient is time-dependent obeying a power 
law, j(t) ~ t~ a . The friction term could thus be written again in form of a fractional 
derivative. Note that for 7 = const, the ordinary Langevin equation is recovered, which is 
a standard model of Brownian motion [Rei65, Ris96]. This relation suggests that physically 
the anomalous cell migration could have its origin, at least partially, in the existence of a 
memory- dependent friction coefficient. The latter, in turn, might be explained by anoma- 
lous rheological properties of the cell cytoskeleton, which consists of a complex biopolymer 
gel [Scm07]. 

Secondly, what could be the possible biological significance of the observed anomalous cell 
migration? Both the experimental data and the theoretical modeling suggest that there 
exists a slow diffusion on small time scales, whereas the long-time motion is much faster. In 
other words, the dynamics displays intermittency qualitatively similar to the one outlined in 
Section 4.1. Interestingly, there is an ongoing discussion about optimal search strategies of 
foraging animals such as albatrosses, marine predators and fruit flies, see, e.g., Ref. [Edw07] 
and related literature. Here it has been argued that Levy flights, which define a funda- 
mental class of anomalous dynamics [Kla08], are typically superior to Brownian motion for 
animals in order to find food sources. However, more recently it was shown that under 
certain circumstances intermittent dynamics is even more efficient than pure Levy motion 
[Ben06] . The results on anomalous cell migration presented above might thus be biologically 
interpreted within this context. 



5 Summary 



This review has covered a rather wide range of topics and methods: Chapter 2 has introduced 
to the concept of deterministic chaos by defining and calculating fundamental quantities 
characterizing chaos such as Ljapunov exponents and dynamical entropies. These quanti- 
ties were shown to be intimately related to each other as well as to properties of fractal sets. 
Chapter 3 started by reminding of simple random walks on the line, their characterization in 
terms of diffusive properties, and the relation to elementary concepts of Brownian motion. 



6 We emphasize that only the msd and the decay of velocity correlations are correctly reproduced by 
solving such an equation [LutOl], whereas the position distribution functions corresponding to this equation 
are mere Gaussians in the long time limit and thus do not match to the experimental data. 



44 5 Summary 



These basic ideas were then discussed in a chaotic setting in form of deterministic diffu- 
sion. A formula was derived exactly expressing diffusion in terms of the chaos quantities 
introduced in the previous chapter. Chapter 4 generalized the concept of normal diffusion 
leading to anomalous diffusion. A simple deterministic model generating this type of diffu- 
sion was introduced and analyzed both numerially and by means of stochastic theory. For 
the latter purpose, continuous time random walk theory was explained and applied leading 
to a generalized, fractional diffusion equation. As an example of experimental applications 
of these concepts, anomalous biological cell migration was discussed. Experimental results 
for the mean square displacement and for the probability distribution in position space 
matched nicely to the predictions of a stochastic model in form of a fractional diffusion 
equation, defined both in position and velocity space. The scope of this review thus spans 
from very simple, abstract models to experiments and from basic dynamical systems theory 
to advanced methods of stochastic analysis. 

Of course, this work poses a wealth of open questions. Here we restrict ourselves to only 
one of them which we consider to be of particular importance: We could understand the 
origin of normal diffusion in terms of microscopic deterministic chaos by applying a combi- 
nation of methods from statistical physics and dynamical systems theory; but what's about 
anomalous diffusion? To our knowledge, yet there is no analogous theory available, like the 
escape rate formalism for normal diffusion, which explains the origin of anomalous diffusion 
in terms of weak chaos. This is the reason why here we restricted ourselves to applying 
numerical and stochastic methods to an anomalous deterministic model. We believe that 
constructing such a microscopic dynamical systems theory of anomalous deterministic trans- 
port poses a big challenge for future work in this field. 
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